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Figure 1: Parallax barriers and holograms are two forms of view -dependent display that are typically considered under distinct physical 
interpretations, but actually consist of similar underlying features, (left) A parallax barrier image comprised of different discrete tiles of 
angular content (center-bottom) are usually explained by treating light as a ray. By illuminating one discrete patch of a hologram at a time 
and recording the resulting images (center-top), we describe a hologram in light field terminologies commonly applied to parallax displays. 
In this paper, we develop a framework to explain these similarities and then apply it to the creation of novel display forms. 



Abstract 

In this paper we explore how light propagates from thin elements 
into a volume for viewing. In particular, devices that are typi- 
cally connected with geometric optics, like parallax barriers, differ 
in treatment with those that obey physical optics, like holograms. 
However, the two concepts are often used to achieve the same effect 
of capturing or displaying a combination of spatial and angular in- 
formation. This paper attempts to connect the two approaches under 
a general framework based in ray space, from which insights into 
applications and limitations of both parallax-based and holography- 
based systems can be observed. We show that each display form 
can generate a light distribution that can always be expressed as a 
rank-1 matrix. Knowledge of this limitation is then discussed in 
the context of extending the capabilities of current display forms 
by considering the use of partially coherent light. 

1 Introduction 

There are numerous questions surrounding the operation of holo- 
grams from a computer graphics and display perspective that do 
not have an obvious answer. For example, can a hologram be repre- 
sented as a light field? Can a hologram create any light distribution 
we want? Can we create a parallax barrier by taking strips of a holo- 
gram? What does it mean to say that a hologram creates a "wave- 
front", but a parallax barrier does not? Based on recent connections 
made between g eometric and physical op tics interpretation of light 
propagation by [Zhang and Levoy 2009], this paper suggests intial 
answers to these questions. 

Parallax barrier displays were invented a little over a century ago, 
and holograms have been around for about half of that time. While 
both are used for the same purpose of presenting a combination of 
spatial and angular information upon illumination, there has been 
little comparison of their capabilities and tradeoffs. This paper 
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brings the two forms of display under a common framework, and 
will explore what is possible at their intersection. 

Parallax barriers, which are conceptually similar to lenticular ar- 
rays, are used to deliver the appearance of a three-dimensional im- 
age from a screen to a user without the need of special glasses. 
This screen is comprised of a plane of pixels with mixed spatial and 
angular content and a plane of slits. Holograms also contain a mix- 
ture of spatial and angular content. A traditional off-axis hologram 
preserves this mixture in the form of interference fringes, usually 
created from exposure to a plane wave and a second wave from an 
object of interest. Upon relighting with a plane wave, diffraction 
effects will create a real and virtual image of the object. If the ob- 
ject has an interesting 3D structure, this too will reappear in both 
the real and imaginary viewing volume. 

There has been much exploration into the different methods of 
generating wavelength-scale amplitude or phase fringes that will 
diffract light to a desired pattern. In this paper, we will be mostly 
concerned with holograms that can be generated computationally. 
Furthermore, treatment will focus on holograms that can be pre- 
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Figure 2: The ray space diagram of a hologram (left) presents both 
spatial and directional distributions of the rays it emits. We show 
how this is equivalent to the angular spectrum of pixels underneath 
a parallax barrier slit (right), just at much smaller scales. 
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Figure 3: Experimental results for scanning and recording the 4D light field function of a hologram. (Left) Three unique recording methods 
each populate the light field, (a) The hologram is segmented into patches and scanned patch-wise, recording the real image, (b) A coherent 
source illuminates the entire hologram and the virtual image is captured from different angular positions, (c) The hologram is illuminated 
patch-wise and the virtual image is reconstructed through image addition. (Middle) The associated recording geometries. (Right) Images of 
the experimental setup for real image scanning and virtual image capture. 



sented in grayscale a thin transparent sheet. This specific holo- 
graphic form is physically identical to the masks that make up a 
parallax barrier display. 

It is well known that both holographic and parallax barrier displays 
are limited in the light distributions they can create. Using a linear 
algebra-based analysis, we will show that each form of display can 
only create light fields that are rank-1 in a certain space. Many 
people have attempted to solve the problem of coming up with the 
best parallax barrier or hologram design to approximate a desired 
light field. What they haven't realized is that they are attempting 
to satisfy the same rank-1 condition. By discussing the two display 
forms side-by-side and exploring their shared fundamental limits, 
we hope to encourage new areas of study at their overlap. Whats 
more, this overlap will only grow as pixel sizes shrink and the line 
between geometric and physical optics becomes less definite. 

1.1 Contributions 

As far as we know, this is the first time holograms and parallax 
barriers have been brought together under a joint geometrical and 
physical optics framework for direct comparison and analysis.We 
will present the following ideas in this paper: 

1. A side -by-side performance analysis of parallax barrier and 
holographic displays based upon discretizing spatial and an- 
gluar resolution. 

2. A framework based in ray space to help show the limited 
space of light distributions that can be created by any thin 
amplitude element in a volume. We will show that this space 
is always rank-1 in the transform domain. 

3. The experimental capture of the light field of a hologram, 
demonstrating that a hologram can simply be thought of as 
a discrete summation of elemental patches that present indi- 
vidual viewpoints of a certain object. 

2 Related Work 

The term "hologram" has been applied to a wide range of media 
over the past sixty years, and this paper does not intend to con- 
sider all of them. The first genre of holograms was a film-based 



media [Gabor 1948, Leith and Upatnie ks 19651, having different 
prope rties if thick or thin, or phase or amplitude |Urbach andM eier 
1969 1 . In this paper, we will be primarily concerned with holo- 
graphic patterns that can be generated on a com puter, some of the 
first of which were presented by Lohmann [1967]. Since these early 
efforts, computer-generated holograms (CGH) have opened up a 
large field o f study in their applic ation to 3D display ( |Benton and| 
Bove 2006 1, [Slinge ret al. 2005] ). However, many of the current 
advanced techniques, often based on segm enting holograms into 
zones, ha ve roots in earlier film-based work |DeBitetto 1969 |Ben-| 
|ton 19691 ). 

CGH's have been extended to model intensity distributions at multi- 
ple planes |Dorsch et al. 1994) and into c ontinuous volumes |Pies-| 
|tun et al. 1996||Shamir and Piestun 20021. Spatially-multiplexed 
holograms, like a holographic stereogram |McCrickerd and G eorge 
1968], display many discrete viewpoints of an object similar to a 
parallax barrier display. They too often exhibit only parallax along 
the horizontal direction, but not always, and pr ovide a user with the 
appearance of a fully 3 D object [Lucente 1 994], like other advanced 
holographic displays |Hilaire et al. 199 1| . A helpful introduction 
to the different methods of encoding a desired display field onto dif- 
ferent two dimensional light modulators can be found in [ Plesniak 
land Halle 20051 . 
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Figure 4: (Left) A parallax barrier can easily create a specific ray 
from a single pixel and a slit, but can only create a discrete approx- 
imation to a curved wavefront. (Right) An amplitude hologram can 
create the same ray with a sinusoidal pattern, but will generate two 
additional orders. It can easily create a curved wavefront with a 
narrow slit. 
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Figure 5: (a) The operation of a parallax barrier display. A screen 
of width L and a second plane of slits separated by w a distance 
d away directs light into specific directions, (b) Coherent illumina- 
tion of a hologram creates both a real and virtual image through 
diffraction from a single plane. A viewer at a distance z will see the 
virtual image appearing on the other side of the hologram. 



The first parallax barrier setup, developed by Ives |1903| , was a 
binocular display delivering two slightly different image perspec- 
tives to each eye. A simple alternative to a parallax barrier is a 
lenticular display, first suggested by Lippmann [1908]. In-depth 
comparisons b etween lentic ular, barrier and integ ral systems can 
be found in |Okoshi 197 6] and [B. Javidi 2009), and a physical 
optics perspective is in [Moller and Travis 2005]. We will treat 
all of these two-plane systems in a simplified manne r, but under a 
ray-space based framework similar to Zwicker et. al [2006], where 
parallels to holography are close. 

Considerable work has also been focused on merg ing wave-based 
holography with geometrical fram eworks [Zhang a nd Levoy 2009 ; 
Ziegler et al. 2007 ; Oh et al. 2009] Several works have drawn some 
simple comparisons betw een what is possible with geom etric-based 
and holographic displays | Halle 1997, Frauel et al. 2004] even ap- 
plied to graphics applications [Escr iva et al. 2007|. Others have in- 
tegrated display forms from the two genres | Bimber 2004 ; Plesniak 
|et al. 2 003]. We hope to expand on the se general com parisons using 
ray space analysis like th e light field [Levoy and Hanrahan 1996]. 
The Wigner distribution [Wigner 1932] is another ray space func- 
tion that has many applications in physical optics [Bastiaans 1979]. 
Holograms in specific have been analyzed from bo th of these ray 
space perspecti ves in pestorf and Lohmann 2008] and [Si tu and| 
Sheridan 2007], but not directly compared to parallax barriers in 
the same space. 



3 Towards a Common Framework 

Two key differences between the display media should be kept in 
mind while our comparison is formulated. First, parallax barriers 
operate in the geometric optics limit, while holograms require the 
physical optics principle of diffraction. This fundamental differ- 
ence is related to the scale of the display pixel. Second, a simple 
parallax barrier display directs unique images to different angles, 
essentially mapping to x at a single depth plane. The operation 
of a hologram, on the other hand, is a little bit more complex, since 
it can create both a real and virtual image. We will see that a holo- 
gram's virtual image is conceptually equivalent to that presented by 
a parallax barrier, while its real image acts as a resolution conjugate. 
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Table 1: Direct comparisons between parallax barrier and holo- 
graphic 3D displays. The top section of the table outlines differ- 
ences in implementation. The bottom section of the chart outlines 
the similarities and differences in the ray space treatment of each. 



3.1 Parallax Barriers Versus Holograms 

The most generic parallax barrier configuration contains two planes 
with no additional optical elements, and light from each pixel only 
travels through one slit (Figure 5(a)). We focus on parallax bar- 
riers, and not lenticular or lenslet arrays, for two reasons. First, 
having both displays simplify down to thin amplitude modulation 
sheets underscores similarities. Second, as parallax barriers become 
increasingly based on LCD technology, which are becoming well 
above hundreds of DPI, the two display forms are converging in 
resolution. Table 1 summarizes many of the main properties of this 
simple parallax barrier along with holograms. 

For a parallax display with a given number of pixels N, it is clear 
that there is a direct tradeoff between the amount of spatial and 
angular content that can be directed to an optimal viewing plane v. 
Specifically, angular resolution {Ores) can be given by the number 
of pixels under each slit, and spatial resolution (x res ) as the number 
of slits, yielding 

N. (1) 



^res^res 



At optimal viewing of this simplified display one ray from each slit 
will enter one eye, and a discrete number of of views are visible 
from different positions along v. 

This discretization is one of the main drawbacks of a parallax bar- 
rier, and leads to issues like aliasing and orthoscopic views. High 
angular resolution is desirable to create a more seamless viewing 
experience. However, parallax barrier displays scale poorly with an 
increase in resolution for a fixed display size, mostly as a result of 
two issues. The first is a decrease in light efficiency, as optimal slit 
width is roughly the width of one display pixel. Thus, efficiency 
is decreased proportional to an increase in angular resolution for 
a fixed pixel size. A lenticular array can be used to improve this 
efficiency, but it will not completely overcome the second issue of 
diffraction. A slit of width s will diffract a ray across an angle given 
by 

sin#=A (2 ) 
2s 



(a) Segment under 1 "pinhole" (b) Segment into patches 
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Figure 6: The discretization of a Fresnel hologram into a series of 
Fourier holograms allows it to be treated similar to a parallax bar- 
rier. Taking numerical examples from the successful display sce- 
narios in Figure^ we can establish the resolution of a strip of a 
parallax barrier (a) will be res = 10. For a Fresnel hologram (b) 
with 10 5 pixels, the associated i res will be 400. 
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Likewise, a lenticular with f-number F will be able to display a 
pixel with a minimum size given by the Airy disk as x — 1.22AF. 
Thus, as systems scale towards smaller pixel and barrier widths, 
physical optics effects cannot be ignored. 

Diffraction is exact how a hologram achieves image creation. The 
thin transmission holograms we are considering here will operate 
under "conventional" holographic methods, in which light from all 
points in the holographic plane diffracts and interferes to produce 
each and every image point in a continuous manner. Many holo- 
grams do not obey this assumption, and by taking advantage of the 
fact that depth cues primarily come from horizontal parallax, can 
significantly reduce required resolution. The well-known rainbow 
hologram visib le under white light [ Benton 1969] and holographic 
stereograms | McCrickerd and George 1968] are examples that can 
enhance viewing conditions using techniques related to but beyond 
the scope of this paper. 

How can we create a single ray or finite beam with a hologram? 
From Figure [4] we see that in the simplest form, a single pixel and 
a slit can be replaced with a small sinusoidal grating and a barrier to 
block two of the three diffraction orders. The width of the ray this 
sinusoidal grating creates will not be finite, however, but is given 
by A0 S = , where z is the image distance and ho is the grating 
width. A basic Fourier hologram, which creates a single real image 
from one perspective, can be thought of as a summation of sinu- 
soidal gratings that diffract light into different viewing directions, 
much like a parallax barrier. The image from a Fourier hologram is 
in the "far-field", where light propagates to a pattern that is a scaled 
Fourier transform of the mask design. 

A Fresnel hologram, unlike a Fourier hologram, produces the famil- 
iar real and virtual images that change depending upon perspective. 
These operate under the assumption that the object to be recon- 
structed is in the "near zone (Fresnel zone)", or relatively close to 
the holographic mask. Upon coherent plane wave illumination, a 
conventional hologram creates a real image and imaginary image at 
locations displayed in Figure 5(b). These images, unlike a parallax 
barrier, do not exhibit discrete angular content, and can provide full 
depth cues to a viewer. For the next two sections, we will focus 
on the Fresnel hologram's real image. The virtual image will be 
discussed in Section 3.4. 



3.2 Discretization of the Hologram 

Although not exact, a convenient way to understand the operation 
of a Fresnel hologram is to split it into small, discrete patches, sim- 
ilar to what is done with a parallax barrier (Figure [6}. Each holo- 
graphic patch operates as an independent Fourier hologram, which 



Figure 7: A numerical comparison between parallax barrier and 
a holographic display shows that the barrier display performs well 
with larger pixels (100 \im), while a hologram performs well with 
smaller pixels (1 \im). 



tile together to create the complete 3D light distribution upon illu- 
mination. Thus, each of these elemental Fourier holograms projects 
its own slightly different perspective of the 3D object to create a real 
image. 

The number of required pixels to fully reconstruct the entire paral- 
lax content in a Fresnel (near-zone) hologram for an image of size 
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Likewise, a good rule of thumb for the generation of a Fourier holo- 
gram is that it must have 4 times the resolution of the real image, 
due to the creation of multiple orders (i.e., the sinusoid mask al- 
ways creates more than 1 ray). Using these two resolution approx- 
imations, the number of elemental patches n p that a large Fresnel 
hologram will contain given a desired spatial resolution i res for the 
reconstructed object is, 



4:ire 



(4) 



This equation is quite similar to {I} that describes a resolution trade- 
off of a parallax barrier. It is very easy to draw a direct parallel 
between the number of patches n p and res of the parallax barrier 
when considering a hologram's real image. 

3.3 A Numerical Comparison 

A direct numerical comparison of the two display technologies 
helps clarify their areas of operation and the idea of treating a holo- 
gram in discrete patches. Figure[7]displays the operation of a paral- 
lax barrier and hologram for a screen with either 10 3 or 10 5 pixels 
fit into 10 cm. The parallax barrier is successful with 10 3 pixels 
that are 100/im wide, consistant with current slit widths [Harrold 
|et al. 2003) , but suffers from diffraction using smaller pixels. For 
the successful parallax barrier, the screen was split up such that 
Xres = 100 and res = 10. 

A hologram performs better with 10 5 pixels that are 1 /im wide, 
becuase it can diffract light across a larger angle (30° compared 
to 0.5°, using ([5])). From {3}, we find that this setup can fully re- 
construct all of the parallax information contained by an object that 
appears 30 cm away and is 5 cm high. 




Figure 8: The virtual image of a Fresnel hologram is conceptually 
the same as the image from a parallax barrier, and the real image 
is a resolution conjugate. Blocking off large regions of each dis- 
play demonstrate this, (a) One pinhole of a parallax barrier will 
just give the angular content from one local region of the image, 
(b) Blocking most of a hologram of two points leads a partially ob- 
scured virtual image, giving angular content from only one point, 
just like in (a). The real image will still be fully visible, (c) A slice 
along the light field's can decribe the operation of a parallax 
barrier and imaginary hologram image, (d) A projection along x 
describes a holographic real image. 



Splitting up the hologram into discrete patches allows us to imagine 
how this successful CGH could be designed. To create a real image 
with 100 pixels of spatial resolution like successful barrier display, 
each Fourier hologram patch must have roughly 400 pixels (Fig- 
ure^. The mask can be split up into 250 elemental components, 
yeilding 250 unique perspectives. This same process will next be 
applied to describe the resolution of the hologram's virtual image, 
which will link it to the image created by a parallax barrier. 

3.4 Resolution and the Real and Virtual Image 

Holographic virtual images are viewed by looking "through" the 
hologram mask (Figure 5(b)). Thus, the 250 discrete Fourier 
patches that fit in our example in the previous section will now 
switch to define the spatial resolution of the virtual image, much 
like the slits of a parallax barrier. The 400-pixel resolution of each 
patch will also switch from providing the spatial resolution of the 
real image to the angular resolution of the virtual image. In sum- 
mary, a hologram's spatio- angular tradeoff is connected to whether 
the real or virtual image is being viewed, as the two are resolution 
conjugates. 

The light field point of view, a joint (x, 0) representation of the 
displayed rays, is helpful at explaining this example. A real image 
is a projection of the light field along the x-axis, while a virtual 
image is a slice along the #-axis, as in (Figure |8]c). Thus, either 
multiple real or virtual images may be recorded to define the light 
field of a hologram. 

3.5 Experimental Demonstration 

Using these new insights, the experimental capture of a hologram's 
light field is now accomplished using three different procedures. 
First, we capture unique real-image views by illuminating different 
locations of the hologram. This is identical to recording the low 
resolution image produced by each discrete Fourier patch (xh,yh) 
of a single angular view (uim,Vi m ). Scanning the illumination to 
multiple spots populates the entire light field, angle by angle. This 
hypothesis is verified by discretizing a recorded silver halide Fres- 
nel hologram of a tea cup into 5 mm x 5 mm patches (Figure 3(a)). 



Each patch acts as a single hologram spatial coordinate, although 
they individually contain an estimated 1000 2 5 micron phase pixels. 
This resolution maps to roughly a 250 square pixel image resolution 
with the 4- 1 resolution rule of thumb. An automated laser scanning 
system captures 400 images to reconstruct a (250,250,20,20) holo- 
gram light field. 

The virtual image is used to reconstruct the object two ways. In one 
method, the entire hologram is illuminated with a beam-expander 
and the camera moves to different angular positions for unique 
views (Figure 3(b)). Now similar to a parallax barrier display, the 
discrete hologram patch coordinates become the spatial resolution 
and camera position defines the angle (uim,Vim). 

In the final method, the hologram is illuminated in discrete patches 
and viewed as a virtual image, but with the camera initially fixed 
(Figure 3(c)). Each patch(xh,yh) is now responsible for a single an- 
gular ray in the virtual image space. An entire holographic record- 
ing is formed by moving the illumination to different patches and 
summing images. 

Besides demonstrating the close link between holograms and light 
fields, this experiment serves as a method to digitally preserve tra- 
ditionally recorded holograms, or even as a method to integrate 
lighting position into more complex displays. Qualitatively, scan- 
recording the real image produces the best results, although it is an 
unconventional technique and to the best of our knowledge has not 
been applied before. 

4 Space of Light Fields and Display Devices 

In this section, we will first show through a linear algebra analysis 
that the space of 3D light distributions from a parallax barrier and 
from a single holographic mask are both Rank- 1 . Then, the entire 
spectrum of achievable light fields (Figure [ToJ ranging from co- 
herent to incoherent light is explained through example to encour- 
age new insights into the design space for 3D displays. We will 
then apply these insights in Section 5 towards the approximation 
of an inverse problem and the creation of a novel display format. 
To achieve this, it will be useful to transfer the problem to a joint 
configuration space comprised of spatial and spatial frequency co- 
ordinates. Following is a brief introduction to this representation 
and its comparison to light field space. 

4.1 Parameters of Ray Space 

The parameterization of light into a joint position-angle ray space 
l(x,6) is well known. In this space, propagation is represented as 
a shear, ray values are always positive, and rays cannot bend upon 
interference with a mask. First considering a parallax barrier (Fig- 
ure [9(a)]), the initial screen of pixels creates a broadband light field 
h(x, 9). This then shears and interacts with a plane of amplitude 
modulating slits, which we will call hix). The slits will either 
block or allow a ray through, leading to an expression for the final 
light field in terms of a multiplication: 

l 3 (x,0) = h(x,0)l 2 (x). (5) 

This light field then shears across a large distance to a viewer's eye, 
which takes a projection along 0. 

To shift our analysis to masks with pixel sizes close to the wave- 
length of light, we must transform the light field into something that 
works with physical optics, or waves. Just as numerous rays can be 
added together to form a light field, so too can any wavefront be 
represented as a summation of plane waves of different spatial fre- 
quencies [Goodman 1996]. The Wigner distribution (Fig. 9(b)) is 
a function that simultaneously presents this spatial and local spatial 




Figure 9: Ray space representations for a parallax barrier (a) and holographic (b) display in an example where both attempt to create a 
three-dimensional image of two points. The parallax barrier will have 4 pixels create a broadband light field, which shears to a mask plane 
and is attenuated. A viewer sees the rotated version of this attenuated light field. A holographic system will use two Fresnel zone plates to 
create two points. The Wigner distribution from this mask will go through identical shears and rotations to a viewer, (c) The large number of 
rays entering a viewer's eyes with the hologram facilitates accommodation. 




Figure 10: The space of4D light distributions. With coherent light, 
one mask with total control over amplitude and phase (A+P) can 
create any physically realizable wavefront. The size of this space is 
rank-1 in mutual intensity space. This is the type of mask we will 
examine in Section 5. With incoherent light, two amplitude masks, 
like a parallax barrier, can occupy the largest space, as the utility 
of phase becomes diminished. The size of this space is also rank-1. 



frequency information of a monochromatic wavefront in a single 
plot. In geometric terms, this distribution can be simply thought of 
as a light field distribution with the ray angle replaced with the 
spatial frequency of its associated wavefront: u — « | . 

It is well known that in the limit of a very small wavelength, phys- 
ical optics-based functions like the Wigner distribution approach 
radiance fu nctions, or rays |Accardi and Wornell 2 009 ; Foley and 
[Wolf 1985| . This implies that the light field and Wi sner distribu- 
tion are applicable at different scales, like the two displays we are 
discussing. A light field, like a parallax barrier, works well when 
variables are much larger than the light wavelength. If we zoom 
into the system and look at pixels close to the size of a wavelength, 
as in a hologram, we simply need to think of rays as plane waves. 

At small scales, if a transparency is illuminated by a coherent plane 
wave parallel to the z-axis, then the resulting ray space diagram af- 
ter passing through it is simply the Wigner distribution of the trans- 



mission mask function t(x): 

W(x, u) = J t (x + f (x - e- 2 « ix ' u du (6) 

The Wigner distribution exhibit similar property as light fields: 1) 
x-shear transform for free-space propagation and 2) projection 
along the spatial frequency yields intensity. It is important to note 
that we are concerned with holograms under coherent light, and 
thus ray spaces of coherent fields. One important property of these 
ray spaces is their inclusion of negative values. Some of the flex- 
ibility of holograms to create complex 3D images can be thought 
of in terms of these negative values. The integration to intensity 
can change much more rapidly over short distances given access to 
negative values, unlike a parallax barrier with only positive rays. 

A second important property of light at small scales is how it 
changes at the interface of a second mask, shown in Figure [TT] 
Since diffraction effects are now permitted, the angle of rays bend 
instead of just being attenuated. The amount of bending depends 
upon the ray space distribution of the mask itself, Wmask(x,u). 
The final ray space distribution W ou t(x, u) is described through a 
convolution along the angular direction, 

Wout{x,u) = W in {x,u) * \uW m ask(x,u). (7) 

In the geometric limit of small wavelengths, the angular 'content' 
of a mask is negligible and can be expressed as a delta function. Re- 
turning to (5]), we can return to the same multiplication relationship 
with, 

I 3 (x,0) = l 1 *l2(x,6o) = h(x,0)l2(x). (8) 

This angular convolution is the fundamental difference in describ- 
ing how rays change versus waves at a mask. 

4.2 Rank Comparison of Hologram and PB 

Similar decompositions in ray space will show the limits of each 
type of display. First considering a parallax barrier, we rewrite |5]) 
in terms of the screen of a parallax barrier s and the barrier mask m. 
The screen creates a broadband light field that propagates a distance 
d to plane m. Using the shear relation, we can write h(x, 9) in 
terms of a sheared s, 

Z 3 (x,0) = s{x-d0)m(x) (9) 




Figure 11: The operation of a thin mask under geometric optics 
considerations and under physical optics considerations. A ray 
passing through a slit is convolved with a 5 -function (vertical slice 
of a horizontal bar in phase space). The same slice through the 
Wigner distribution leads to a function of finite width W m - Convo- 
lution with this function leads to a diffraction blur that is indepen- 
dent of incoming ray angle. 



Thus, we see that the 2D light field from two amplitude planes is an 
outer product of ID real column vectors: 



m(yi)s(y 2 ) T = [LF two planes] 



(10) 



This matrix has rank-1, which is quite a restrictive property. This 
decomposition is most clear when we present the light field in a 
rotated coordinate system, where the mask functions m(yi) and 
s(y2) are the axes (Figure \V2\. Discrete lines of angular content u 
at 45° represent rays at different angles 6 from s through the direct 
relationship u — dQ. This implies that a parallax barrier undersam- 
ples any higher-rank light field it is designed to approximate. To 
avoid aliasing, it must sample the light field at large spatial inter- 
vals. 

The outer product in {9} is often how light field displays are gen- 
erated using either a parallax barrier, lenticular array, or an integral 
imaging system. A specific consequence of parallax barrier dis- 
plays is low light efficiency: to map a desired pixel to a location, all 
other rays blocked. This significant light attenuation may not nec- 
essarily be optimal. Other solutions to m and s could be achieved 
using linear algebra tools like single-value decomposition, which 
can force energy into few eigenvector components. 

Turning to the ray space of a hologram, the easiest way to see how 
it is limited to a rank-1 condition is by examining the forward pro- 
cess of constructing the Wigner distribution. This begins with the 
mutual intensity function J(xi, x 2 ) —< t(x\t* (x 2 ) >, where the 
brackets denote an average. This function is a measure of the corre- 
lation between any two points x\ and x 2 on a wavefront, or a mask 
t. Note that J(x, x) is the intensity at x. For completely coherent il- 
lumination, any two points will be fully c orrelated. Thus, JJx i , x 2 ) 
can be expressed as an outer product [Ozak tas et al. 20 02 1 of the 
mask function t(x±) with its complex conjugate t*(x 2 ). 

From this rank-1 space, we can create the familiar ray space 
picture first by rotating the coordinate system by 45°, and then 
re-scaling the x-axis a factor of 1/2. This is equivalent to a 
change of coordinates from (xi 1 x 2 ) to a new coordinate set 
(x = Xl + X2 } x' — x\ — x 2 \. The Wigner distribution is just the 
Fourier transform of this rotated mutual intensity function along 
the angular axis. Its rank is increased significantly because only 
the Fourier transform along one axis (x 1 ) is taken. However, the 
Wigner distribution remains a highly redundant representation. A 
coherent wavefront distribution after any propagation or modula- 
tion by multiple amplitude screens can always be created from an 
original rank-1 starting point. 
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Figure 12: The light field from a parallax barrier (blue boxes) is 
decomposed into an outer product of screen coordinates s and mask 
coordinates m, and is rank-1. The pinholes (ph) along the mask 
only allow certain strips of a continuous light field through. The 
red box is an example of presenting an aliased light field, where a 
single pixel from screen s is used to express two light field values. 
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Figure 13: The ray space diagram for a hologram under coherent 
light assumptions can be created from a space that is originally 
rank-1. A rank- 1 function in mutual intensity space transforms to a 
rotated coordinate system and then to the Wigner distribution. 



4.3 The Larger Space of Light Fields 

Figure [l0| illustrates the entire hypothetical space of three- 
dimensional light distributions and methods for their generation. 
Given complete control over the light coherence state and the phase 
and amplitude of a mask, any arbitrary 3D distribution that obeys 
the wave propagation equation can be created. While this is an opti- 
mal situation for 3D display, there are a number of practical limita- 
tions. First is a physical limitation: the wave propagation equation 
is limited to smooth changes and out-of-focus nois e can drast ically 
decrease the SNR at a given viewing plane [Dor sch et al. 1 994]. 
The second is a practical limitation: it is difficult to construct a 
light source with a given degree of partial coherence, and a thin 
sheet with both arbitrarily high grayscale and phase resolution. 

Using coherent light, there is a limited set of volumetric wavefronts 
that can be constructed. Any wavefront with a fixed coherence state 
must be definable over a single plane, since the distribution in all 
subsequent planes will be determined by the laws of propagation. 
Therefore, they must be able to be represented with a Wigner distri- 
bution, which we just found is rank-1. Within this space, there are 
even more limited sets of distributions that can be created with just 
amplitude, phase, or two planes of amplitude-only content. Exam- 
ples of these limitations include an amplitude-only grating which 
always exhibits a zeroth order, or a phase-only plate which can not 
create a significant dark region at a short propagation distance. 

A two-plane display with incoherent light can create a set of distri- 



butions that overlaps with but differs from that of single plane under 
coherent light. For example, both can create two points as in Figure 
[9] but only coherent light can create interesting patterns that require 
control over the phase of light, like an optical vortex. Having con- 
trol over phase in a single plane becomes less important for display 
purposes as light becomes more incoherent. Therefore, the sizes 
and concentricity of spaces in Figure [10| change with coherence. 

Pixel size also scales with the axis of coherence. The most interest- 
ing feature of this analysis is the set of distributions that two ampli- 
tude modulation planes can create, and how it changes. The utility 
of a two-plane display like the parallax barrier does not disappear 
when diffraction effects arise: it simply must be treated differently. 
As display feature sizes shrink, it seems that displays should begin 
to operate in a domain that moves away from completely incoherent 
light. 

5 Conclusion and Future Work 

We hope that some of connections made between the operation of 
parallax barriers and holograms stimulate further work at the inter- 
section of the two display forms. With both a common framework 
to view resolution tradeoffs and also a shared rank-1 limitation in 
transform coordinates, there appears to be some significant overlap 
in functionality. At a minimum, we hope that approaching holo- 
grams from a discretized, more geometric based approach has of- 
fered some additional insight into their operation. 

Looking towards the future, it is possible to expand upon the rank 
analysis to design both incoherent, coherent, and even partially 
coherent-based displays that would be better suited for a specific 
display task. The inverse problem of moving from a particular de- 
sired light field to a mask and illumination source with a determined 
coherence state is the next step in this design process. Since the mu- 
tual intensity rank scales with coherence state for a single mask, 
light field distributions that otherwise could not be created with 
current displays may be generated considering partial coherence. 
Another direction would be to bring in lenticular displays into the 
analysis, where the angle of outcoming rays can be altered, instead 
of only considering their attenuation. 

In terms of future experimental work, we've taken part in pre- 
liminary discussion with museum curators interested in digitally 
preserving the largest collection of recorded holograms using our 
laser-scanning procedure. Furthermore, following the discrete 
Fourier hologram approach may allow for computationally simple 
and direct constructionof full Fresnel CGH holograms. Finally, pu- 
rusing a hybrid form of display using both a holographic screen 
and parallax barrier layer may offer additional dimensions of de- 
sign freedom. 
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